Web Survey Bibliography
Title Ein online Experiment: Varianten der online Fragebogengestaltung und ihr Einfluss auf die Bearbeitungseffizienz
Author Sabin, S., Jirasko, M.
Year 2005
Access date 22.04.2005
Abstract Please remember your last online study! How many questions did you pool on a page? Did you use small radios or did you prefer large buttons? And did you use the often criticised matrix format? The decision for either format may be based on methodical considerations (e.g. number of drop outs), but the usability and the ease of questionnaire development may also influence this decision. The mode "one question per page" seems to be quite advantageous, since a comprehensive drop out analysis can be done. To further investigate participant satisfaction and time efficiency of this mode an online experiment was conducted. Furthermore, this experiment was designed to test which kind of input field and layout would be preferable in regards to the above criteria of usability and time efficiency. The experiment consisted of a questionnaire, which was presented in five different modes. The participants were randomly assigned to the different modes. The handling time and assessment of the usability of the modes were recorded. The modes vary in regards to the number of questions presented on one page (one question per page, several questions per page so that scrolling is not necessary, all questions on one page), the input fields (radios, buttons) and the layout. The experiment lasted 4 weeks, and 93 participants answered all questions. Statistically significant differences in handling time were found for the five modes. The shortest handling time was observed for the questionnaire in the mode "one question per page" using buttons as input fields. Statistically significant differences between the five modes were also found for the retrospectively rated efficiency. The highest efficiency was again reported for the mode "one question per page" with buttons as input fields. The worst rating was assigned to the mode "one question per page" with radios as input fields. Altogether the mode "one question per page" can be recommended, if buttons are used as input fields, and if a high performance server and fast internet connection are available.
Abstract - optional Bitte erinnern Sie sich an Ihre letzte Online Untersuchung! Wie viele Fragen haben Sie auf einer Seite zusammengefasst? Haben Sie die kleinen Radios verwendet oder große Buttons? Und verwenden Sie das oft kritisierte Matrixformat? Die Entscheidung für die eine oder andere Variante mag auf Grund von methodischen Aspekten (Drop Out Analyse) getroffen werden, aber auch Überlegungen zur Usability oder einfach die Ökonomie der Fragebogenerstellung mögen die Hauptentscheidungskriterien gewesen sein. Bisher fehlten noch klare Belege dafür, ob die, aus methodischen Aspekten vorteilhafteste Variante - eine Frage pro Seite - ,von den Teilnehmern auch zeiteffizient bearbeitet werden kann und angenommen wird. Außerdem sollte noch zur Klärung der Frage beigetragen werden, welche Art der Eingabefelder und Form des Layouts hinsichtlich Bearbeitungszeit und Beliebtheit bei den Teilnehmern zu bevorzugen ist. Deswegen wurde ein online Experiment durchgeführt in dem 5 verschiedene Darbietungsformen bewertet und die Bearbeitungszeit gemessen wurde. Diese Formen variieren in der Anzahl der Fragen je Seite (eine Frage pro Seite, mehrere Fragen, jedoch ohne Scrollen, alle Fragen auf einer Seite), den verwendeten Antwortfeldern (Radios, Buttons) und bzw. oder dem Layout (Matrixform). Am Experiment nahmen im Zeitraum von 4 Wochen insgesamt 93 Personen vollständig teil. Es zeigten sich signifikante Unterschiede in der (objektiven) Bearbeitungszeit eines Fragebogens zur Bedeutung des Internets, je nachdem in welcher Darbietungsform er präsentiert wurde. Dabei konnte die Bearbeitungszeit des Fragebogens in der Variante "eine Frage pro Seite" mit Buttons deutlich gesenkt werden. Der erlebte Aufwand des Fragebogens und die Bewertung unterschieden sich ebenfalls überzufällig, abhängig von den verschiedenen Darbietungsformen. Am wenigsten aufwendig erschien wieder die Variante "eine Frage pro Seite" mit Buttons, die schlechteste Bewertung erhielt die Variante "eine Frage pro Seite" mit Radios. Insgesamt kann man sowohl aufgrund von methodischen als auch usability Überlegungen die Variante "eine Frage pro Seite" empfehlen, sofern Buttons verwendet werden und ein high speed Server mit guter Verbindung vorhanden ist.
Access/Direct link Homepage - conference (abstract)
Year of publication2005
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - 2005 (76)
- The ethics of research using electronic mail discussion groups; 2005; Kralik, D., Warren, J., Koch, T., Pignone, G., Price, K.
- The Analyses of Domestic Study about Internet Survey; 2005; Rui, L., Tie-ying, S.
- Controlling the Baseline Speed of Respondents: An Empirical Evaluation of Data Treatment Methods of...; 2005; Mayerl, J.
- Determinanten der Rücklaufquote in Online-Panels; 2005; Batanic, B., Moser, K.
- On the cost-efficiency of probability sampling based mail surveys with a Web response option; 2005; Werner, P.
- Expert workshop on mixed mode data collection in comparative social surveys; 2005; Roberts, C.
- The Effect Of A Simultaneous Mixed-Mode (Mail And Web) Survey On Respondent Characteristics And Survey...; 2005; Brennan, M.
- The total survey error approach. A guide to the new science of survey research; 2005; Weisberg, H. F.
- The professional respondent problem in online panel surveys today; 2005; Fulgoni, G.
- Satisficing behavior in online panelists; 2005; Downes-Le Guin, T.
- Reading behavior in the digital environment: Changes in reading behavior over the past ten years; 2005; Liu, Z.
- Rating versus comparative trade-off measures. Trending changes in political issues across time and predictive...; 2005; Thomas, R. K., Behnke, S., Johnson, Al., Sanders, M.
- Publication bias: Recognizing the problem, understanding its origins and scope, and preventing harm; 2005; Dickersin, K.
- Panel proliferation and quality concerns; 2005; Faasse, J.
- Gricean effects in self-administered survey. Ph.D. Dissertation; 2005; Yan, T.
- Drop-down boxes, radio buttons, or fill-in-the-blank? Web survey scale-type effects; 2005
- Does weighting for nonresponse increase the variance of survey means?; 2005; Little, R. J., Vartivarian, S.
- Big scale observations gathered with the help of client side paradata; 2005; Haraldsen, G., Kleven, O., Sundvoll, A.
- User Interface Design and Evaluation ; 2005; Stone, D., Jarrett, C., Woodroffe, M., Minocha, S.
- Adding Value to Data Through Improved Access. The Case for Web Portals; 2005; Baker, R. P.
- Multi-Mode Research and Data Linkage. Theoretical and Practical Advice; 2005; Terhanian, G.
- Architectural Design of a Survey Questionnaire and Respondent Data Repository. Practical Considerations...; 2005; Cookson, P., Sobell, J.
- Developing and validating a nursing website evaluation questionnaire; 2005; Tsai, S. - L., Chai, S.-K.
- Workaround: Site’s surveys beat pop-up blockers, yield responses; 2005; Arnold, C.
- The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research; 2005; Konstan, J. A., Ross, M. W., Rosser, B. R. S., Stanton, J. M., Edwards, W. M.
- Standards in Online Surveys. Sources for Professional Codes of Conduct, Ethical Guidelines and Quality...; 2005; Kaczmirek, L., Schulze, N.
- Computer adaptive testing; 2005; Gershon, R. C.
- Ego control and ego-resiliency: Generalization of self-report scales based on personality descriptions...; 2005; Block, J., Funder, D. C., Letzring, T. D.
- The Web experiment list: A Web service for the recruitment of participants and archiving of Internet...; 2005; Reips, U. -D., Lengler, R.
- Survey of substance use among high school students in Taipei: Web-based questionnaire versus paper-and...; 2005; Wang, Y. C., Lee, C. M., Lew-Ting, C. Y., Hsiao, C. K., Chen, W. J.
- Web Surveys. A Brief Guide on Usability and Implementation Issues; 2005; Kaczmirek, L.
- An assessment of measurement invariance between online and mail surveys ; 2005; Deutskens, E., de Ruyter, K., Wetzels, M.
- E-mail versus Web survey response rates among health education professionals; 2005; Kittleson, M. J., Brown, S. L.
- Toward An Open-Source Methodology: What We Can Learn From The Blogosphere; 2005; M.
- Aux Abonnes Absents: Liste Rouge Et Telephone Portable Dans Les Enquetes En Population Generale Sur...; 2005; Beck, F., ., Peretti-Watel, P.
- Web Versus Paper Questionnares: A Design and Functionality - Comparison; 2005; Jones, Ja., Fraser, C., Dowling, Z.
- Web Surveys and the new Disability Discrimination Act; 2005; Macer, T.
- Mixed-mode Surveys Using Mail and Web Questionnaires; 2005; Meckel, M., Baugh, P., Walters, D.
- Sampling procedure, questionnaire design, online implementation; 2005; Jackob, N., Arens, J., Zerback, T., Jowell, R., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S.
- Alternative Modes for Health Surveillance Surveys: An Experiment with Web, Mail, and Telephone; 2005; Link, M. W., Mokdad, A.
- An Experimental Comparison Of Web And Telephone Surveys; 2005; Fricker, S., Galesic, M., Tourangeau, R., Yan, T.
- Organizational Virtual Communities: Exploring Motivations Behind Online Panel Participation; 2005; Daugherty, T., Lee, W.-N., Gangadharbatla, H., Kim, K., Outhavong, S.
- Promoting Uniform Question Understanding in Today's and Tomorrow's Surveys; 2005; Conrad, F. G., Schober, M. F.
- Is a Web survey as effective as a mail survey? A field experiment among computer users; 2005; Kiernan, N. E., Kiernan, M., Oyler, M. A., Gilles, C.
- The effect of personalization on response rates and data quality in web surveys; 2005; Heerwegh, D., Vanhove, T., Matthijs, K., Loosveldt, G.
- When Methodology Interferes With Substance; 2005; Schoen, H., Faas, T.
- Web-based and Mailed Questionnaires: A Comparison of Response Rates and Compliance; 2005; Baelter, K., Balter, O., Fondell, E., Trolle-Lagerros, Y.
- Bleeding Edge or Proven Technology? The Fact and the Fiction of Mobile Survey Computing; 2005; Cameron, M. R.